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INSPECTION SYSTEMS AND METHODS 
BACKGROUND 

Computing devices such as personal computers (PCs) typically include one or 
more printed circuit boards (PCBs) on which various components are mounted. 
Traditionally, such components are movmted to PCBs using surface mount technology 
in which the components are secured to the PCB using solder paste. More recently, 
press-fit technology has been developed through which pins, either those of a given 
component or individually, are pressed into a PCB using a large force, such as several 
tons. 

FIGs. 1 A and IB illustrate an example of press fitting of individual connector 
pins 100 into a PCB 102. As is depicted in those figures, the pins 100 are passed 
through holes 104, called through holes, that extend from a bottom side 106 of the 
PCB 102 to a top side 108 of the PCB. The through holes 104 often comprise metal 
barrels 110 that extend along the length of the holes. The pins 100 are held in place 
within the barrels 110 by deformable portions of the pins (not shown) that are 
inwardly compressed when the pins are pressed into the PCB 102 from the bottom 
side of the PCB using base portions 1 12 of the pins. 

It is common to inspect the connection of components to a PCB during 
manufacturing to ensure that the various components are correctly mounted to the 
PCB. One common inspection method is two-dimensional automatic optical 
inspection (AOI) in which machine vision techniques are used to analyze the 
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connection of the components to the PCB. Although two-dimensional AOI is 
reasonably effective for inspecting the connection of components that have been 
attached to the PCB using surface mount technology, AOI is less effective for 
inspecting press-fit connections. The reason for this is that, for a proper connection, a 
5 pin must protrude a given distance beyond the top surface of the PCB (see FIGs. 1 A 
and IB). AOI techniques, however, only employ two-dimensional viewing from a 
position directly above the PCB. Therefore, AOI cannot distinguish between a pin 
that correctly protrudes from its through hole, and a pin that is wholly contained 
within the through hole {e.g., due to crimping or folding of the pin within the through 

10 hole). Moreover, it is possible for AOI techniques to falsely indicate a proper press- 
fit connection even when a pin is not contained within a through hole by mistakenly 
identifying the through hole barrel as a pin. 

Although proper moimting of a press-fit connector pin could be confirmed 
using three-dimensional inspection equipment (e.g., three-dimensional AOI), such 

15 equipment is undesirably complex. For example, to properly inspect a pin in three 
dimensions, such equipment may require as many as five cameras, one camera 
positioned directly above the pin and four cameras placed at various lateral positions 
around the perimeter of the pin. In addition to the expense of such equipment, 
complex software must be used to coordinate and analyze all of the data collected by 

20 the three-dimensional inspection equipment. 

From the above, it can be appreciated that it would be desirable to have a 
system and method for effectively inspecting press-fit connections that does not 
require three-dimensional inspection equipment. 
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SUMMARY 

Disclosed are inspection systems and methods. In one embodiment, a system 
comprises logic configured to identify a tip of a pin that has been press fit into a 
circuit board, logic configured to measure characteristics that pertain to a flat end 
5 surface and a chamfered surface of the identified pin tip, logic configured to compare 
the measured characteristics with at least one of stored reference values and each 
other, and logic configured to make a final decision as to whether the pin is properly 
installed based upon results of the comparing performed by the logic configured to 
compare. 

10 In another embodiment, a system comprises a camera adapted to capture 

images, a first lighting source that is configured to illuminate an object fi*om a first 
direction, a second lighting source that is configured to illuminate the object fi^om a 
second direction, and an image analysis system configured to control the camera so as 
to capture a first image of the object when illuminated by the first lighting source and 

15 capture a second image of the object when illuminated by the second lighting source, 
the image analysis system further being configured to measure characteristics of the 
object and compare the measured characteristics with at least one of stored reference 
values and each other for purposes of making a final decision as to the object. 

In one embodiment, a method comprises capturing an image of a circuit board 

20 location at which a pin is to have been press-fit, identifying a feature in a captured 
image that may comprise a tip of the pin, measuring characteristics that pertain to 
particular features of the identified pin tip, comparing the measured characteristics 
with at least one of stored reference values and each other, and making a final 
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decision as to whether the press-fit connection is acceptable based upon results of the 
comparing. 

BRIEF DESCRIPTION OF THE DRAWINGS 

5 The disclosed systems and methods can be better understood with reference to 

the following drawings. The components in the drawings are not necessarily to scale. 

FIG. 1 A is a perspective view of connector pins that have been press fit into a 
printed circuit board. 

FIG. IB is a side view of the connector pins and printed circuit board of FIG. 1 A. 
10 FIG. 2 is a schematic view of an embodiment of a system for inspecting press-fit 

connections. 

FIG. 3 is a block diagram of an embodiment of a computing device of the system 
shown in FIG. 2. 

FIG. 4 is a schematic cross-sectional view of a lighting head of the system shown 
15 in FIG. 2 and illustrates light sources used to illuminate connector pins. 

FIG. 5 is a partial perspective view of a connector pin illustrating a flat end 
surface of the pin and chamfered surfaces of the pin adjacent the flat end surface. 

FIG. 6A is a schematic view of an embodiment of capturing an image of the flat 
end surface of the pin of FIG. 5. 
20 FIG. 6B is a schematic view of an embodiment of capturing an image of a 

chamfered surface of the pin of FIG. 5. 

FIG. 7A is an example captured image of the flat end surface of the pin resulting 
fi-om the illumination and capture depicted in FIG. 6A. 
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FIG. 7B is an example captured image of the chamfered surfaces of the pin 

resulting from the illumination and capture depicted in FIG. 6B. 

FIG. 7C is an example composite image comprising image data of the images of 

FIGs. 7A and 7B. 

5 FIG. 8A illustrates an embodiment of defining an image analysis line for the 

composite image of FIG. 7C. 

FIG. SB provides plots of pixel intensity versus distance along the image analysis 
line shown in FIG. 8A. 

FIG. 9A illustrates an embodiment of defining an image analysis line for a first 
1 0 defective press-fit connection. 

FIG. 9B provides plots of pixel intensity versus distance along the image analysis 
line shown in FIG. 9A. 

FIG. lOA illustrates an embodiment of defining an image analysis line for a 
second defective press-fit connection. 
15 FIG. lOB provides plots of pixel intensity versus distance along the image 

analysis line shown in FIG. lOA. 

FIG. 11 is a flow diagram of an embodiment of a method for inspecting a press- 
fit connection. 

FIG. 12 is a flow diagram of an embodiment of a method for inspecting 
20 connection of an element to a circuit board. 

DETAILED DESCRIPTION 
Disclosed are inspection systems and methods, including systems and methods 
for inspecting circuit board connections, such as press-fit pin connections. As is 
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described in greater detail below, the systems and methods employ a single camera that 
captures hght reflected from a connector pin (or through hole in which a pin was 
supposed to have been installed) from multiple angles for the purpose of detecting and 
analyzing features of the pin tip so that a final determination may be made as to whether 
5 the press-fit connection is acceptable or unacceptable (i.e., defective). In some 
enibodiments, image data pertaining to the flat pin surface and the chamfered surfaces of 
the pin are collected (when present) and analyzed relative to reference data pertaining to 
a properly-installed pin. Pins whose orientation indicated by the image data differs from 
the reference data beyond predetermined thresholds may be identified as defective. 

10 Although the discussions that follow are specifically directed at press-fit pins, the 
disclosed systems and methods could, however, be adapted to inspect other features. 
Accordingly, the disclosed systems and methods more generally comprise systems and 
methods for inspecting connection of an element to a circuit board (or other member). 

Referring now in more detail to the drawings, in which like numerals indicate 

15 corresponding parts throughout the several views, FIG. 2 illustrates a press-fit 
connection inspection system 200. As shown in the figure, the inspection system 200 
includes a two dimensional manipulator 202 that is configured to displace a camera 204 
in X and y directions. The camera 204 comprises an analog or a digital camera and, by 
way of example, comprises a charge-coupled device (CCD). Attached to the camera 204 

20 is a lighting head 206 that, as is described in greater detail below, is configured to shine 
light on a printed circuit board (PCB) 208, which comprises at least one press-fit 
connection, in at least two different directions. In some embodiments, the hght head 206 
is configured to shine light on the PCB 208 from both a nearly perpendicular direction 
and a nearly parallel direction. The PCB 208 is displaced by a conveying mechanism. 
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depicted by a conveyor 210, that positions the PCB below the light head 206 and camera 
204. The manipulator 202 is controlled by a computing device 212, such as a personal 
computer (PC). 

FIG. 3 illustrates an embodiment for the computing device 212 shown in FIG. 2. 
As indicated in FIG. 3, the computing device 212 comprises a processing device 300, 
memory 302, a user interface 304, and at least one input/output I/O device 306, each 
of which is connected to a local interface 308. 

The processing device 300 can include a central processing unit (CPU) or an 
auxiliary processor among several processors associated with the computing device 
212, or a semiconductor-based microprocessor (in the form of a microchip). The 
memory 302 includes any one of or a combination of volatile memory elements (e,g., 
RAM) and nonvolatile memory elements (e.g., read only memory (ROM), hard disk, 
etc.). 

The user interface 304 comprises the components with which a user, such as a 
system operator, interacts with the computing device 212, such as a keyboard and 
mouse, and a device that provides visual information to the user, such as a cathode ray 
tube (CRT) or liquid crystal display (LCD) monitor. 

With further reference to FIG. 3, the one or more I/O devices 306 are adapted 
to facilitate communication with other devices. By way of example, the I/O devices 
306 include one or more of a universal serial bus (USB) or a small computer system 
interface (SCSI) connection component, and/or network communication components 
such as a modem or a network card. 

The memory 302 comprises various programs including an operating system 
310, a manipulator controller 312, a camera controller 314, and an image analysis 
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system 316. The operating system 310 controls the execution of other programs and 
provides scheduling, input-output control, file and data management, memory 
management, and communication control and related services. The manipulator 
controller 312 is configured to control displacement of the manipulator 202 (FIG. 2) 
and, therefore, the position of the camera 204. The camera controller 314 is 
configured to control operation of the camera 204 as well as the Ughting head 206. 
Finally, the image analysis system 316 is configured to analyze images captured by 
the camera 202 and, ultimately, make a final determination as to the adequacy of a 
press-fit connection. 

Various programs (i.e., logic) have been described herein. These programs can 
be stored on any computer-readable medium for use by or in connection with any 
computer-related system or method. In the context of this document, a computer- 
readable medium is an electronic, magnetic, optical, or other physical device or means 
that contains or stores a computer program for use by or in cormection with a 
computer-related system or method. These programs can be embodied in any 
computer-readable medium for use by or in connection with an instruction execution 
system, apparatus, or device, such as a computer-based system, processor-containing 
system, or other system that can fetch the instructions from the instruction execution 
system, apparatus, or device and execute the instmctions. 

FIG. 4 is a cross-sectional view that illustrates the lighting head 206 (FIG. 2) in 
greater detail. As is indicated in FIG. 4, the lighting head 206 comprises first and second 
light sources 400 and 402 that are adapted to shine light on a PCB, and its press-fit pins, 
for purposes of capturing images with the camera 202. The first light source 400 is 
adapted to shine light nearly perpendicular to the PCB. Therefore, as indicated in FIG. 
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4, the first light source 400 is adapted to shine light at an angle, 0 , relative to horizontal 
(/.e., a plane that is parallel to the plane of the PCB). By way of example, that angle is 
approximately 60 to 90 degrees. For instance, © may be equal to approximately 70 
degrees. The second light source 402 is adapted to shine light nearly parallel to the PCB. 
Therefore, as indicated in FIG. 4, the second light source 402 is adapted to shine light at 
an angle, 0 , relative to horizontal {i.e., a plane that is parallel to the plane of the PCB). 
By way of example, that angle comprises approximately 10 to 45 degrees. For instance, 
<D maybe equal to approximately 15 degrees. 

Each light source 400, 402 may comprise one or more light-emitting elements. 
By way of example, each light source 400, 402 comprises at least one laser emitting 
diode (LED) (not shown) that is capable of emitting focused light in a particular 
direction. As is further depicted in the cross-sectional view of FIG. 4, each light source 
400, 402 is configured to shine light fi-om around the entire circumference of the lighting 
head 206. Therefore, images of a pin under inspection may be captured firom the entire 
periphery of the pin. Optionally, different color light may be emitted fi*om the two light 
sources 400, 402. Although not necessary for computer inspection of the press-fit 
connections, different colors may be usefiil to the operator when observing composite 
images of a pin tip (see below for a discussion of composite images). 

FIG. 5 provides an enlarged view of the tip 500 of an example connector pin 
502. The connector pin 502 may comprise an individual, i.e., independent, pin, or may 
comprise a pin of a given component that is to be mounted to a PCB. In either case, the 
pin tip 500 comprises a flat end surface 504, and at least one chamfered surface 506 that 
is adjacent the flat end surface. In the embodiment illustrated in FIG. 5, the pin tip 500 
comprises four chamfered surfaces 506 (only two visible in FIG. 5). Alternatively, 
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however, a tip of a connector pin may comprise two opposed chamfered surfaces. As is 
described below, the number of chamfered surfaces comprised by a given pin is not 
critical to the inspection process. Below the chamfered surfaces 506 are lateral sides 508 
of the pin 502 that extend along the length of the pin. 

FIGs. 6A and 6B schematically depict illumination and image capture of the pin 
502 shown in FIG. 5. In particular, FIG. 6A depicts illumination and image capture of 
the flat end surface 502, while FIG. 6B depicts illumination and image capture of one of 
the chamfered surfaces 506. Beginning with FIG. 6A, the pin 502 is illuminated using 
the first light source (see reference numeral 400 in FIG. 4) such that light is directed 
nearly perpendicular to the flat end surface 504. With such illumination, the light 
incident upon the flat end surface 504 is reflected directly back to the camera 204. 
However, due to the distinct orientations of the other surfaces of the pin 502, including 
the chamfered surfaces 506 and the lateral sides 508, the light reflected off of those 
surfaces is not directly reflected back to the camera 204. As a result of such 
illumination, the camera 204 primarily captures an image of the flat end surface 504 to 
the exclusion of the chamfered surfaces 506 and the lateral sides 508. 

Referring next to FIG. 6B, the pin 502 is illuminated using the second Hght 
source (see reference numeral 402 in FIG. 4). In this case, the light incident upon the 
chamfered surfaces 506 is reflected back to the camera 204 while light incident upon the 
other pin surfaces, including the flat end surface 504 and lateral sides 508, is not. As a 
result, the camera 204 primarily captures an image of the chamfered surfaces 506 to the 
exclusion of the flat end surface 504 and the lateral sides 508. 

FIGs. 7A and 7B illustrate captured images 700 and 702 that result from the 
nearly perpendicular and nearly parallel illumination and capture of FIGs. 6A and 6B, 
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respectively. As is evident in FIG. 7A, the flat end surface 504 is prominently shown 
(identified with shading in FIG. 7A), while the other surfaces of the pin are not visible 
(or are far less prominent). In addition to the flat end surface 504, visible is the metal 
barrel 110 (FIG. 1) in which the pin is inserted. As shown in FIG. 7B, two chamfered 
surfaces 506 are prominent (identified with shading). Again, the metal barrel HO in 
which the pin is inserted is visible. Once both images 700, 702 have been captured (e.g.^ 
sequentially), the two images may. be combined to fomi a composite image 704 (FIG. 
7C) that may be used to perform the press-fit connection analysis. 

FIGs. 8A and SB illustrate analysis of a composite image such as that shown in 
FIG. 7C. As indicated in FIG. 8, the composite image 800 may be shown to the operator 
in a viewing window 802. Identified in the viewing window 802 is an image analysis 
line 804 that has been defined by the image analysis system 316 (FIG. 3). In the 
embodiment shown in FIG. 8A, the image analysis line 804 is vertical so as to cross two 
chamfered surfaces 506 (a "top" and a "bottom" chamfered surface in this case) and the 
flat end surface 504. However, the analysis line may be defined in any orientation in 
which two chamfered surfaces 506 and the flat end surface 504 are crossed. Notably, 
multiple analysis lines may be defined ie.g,^ a vertical and a horizontal line), if desired, 
so as to cross all chamfered surfaces 506 of a pin. 

Before the image anal)/sis line 804 can be defined by the image analysis system 
316, the system must first identify the location of the pin tip. This is accomplished by 
first performing correlation pattern matching in which the image data contained in the 
composite image 800 is compared to image data of a reference pin. In particular, pattern 
matching searches are performed on the composite image 800 to identify a match with a 
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predetermined model of a reference pin tip. Such pattem matching is known to persons 
having ordinary skill in the art. 

Once the analysis line 804 has been defined, the image data (i.e., pixel data) 
along the line can be analyzed for the purpose of determining whether the press-fit 
connection of the pin is acceptable or unacceptable? (z.e., defective). The analysis line 
804 is defined relative to the composite image 800 instead of the separate images that the 
composite image comprises for purposes of conducting the analysis of both the flat end 
svirface 504 and the chamfered surfaces 506 at the same time. Despite such 
simultaneous analysis of the composite image 800, the image analysis system 316 
"knows" the origin of all image data that comprises the composite image and, therefore, 
can identify which data came fi:om which image that was used to generate the composite 
image. Because of this fact, the image analysis system 316 can generate separate plots 
for both the image of the flat end surface 504 and the image of the chamfered surfaces 
506 along the analysis line 804. 

In the first stage of the press-fit connection analysis, the image analysis system 
316 correlates pixel intensity with distance along the analysis line 804. For instance, the 
image analysis system 316 can plot two lines that represent the two channels of data that 
comprise the composite image 804 (/.e., the two images that were combined to form the 
composite image). FIG. 8B illustrates such plotting. As indicated in FIG. 8B, a first line 
A represents the pixel intensity along the analysis line 804 for the image captured of the 
flat end surface 504, and a second line B represents the pixel intensity along the analysis 
line for the image captured of the chamfered surfaces 504. 

Using the data of the two plotted lines A and B, the image analysis system 316 
can evaluate the characteristics of the captured pin tip and later make individual 
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determinations as to each. By way of example, the following characteristics can be 
evaluated {i.e., measured) in relation to each pin feature: 

Top chamfered surface: 

1 . Surface length (top to bottom edge); 

2. Peak intensity; 

3 . Peak intensity position; 
Flat end surface: 

4. Surface length (top to bottom edge); 

5. Peak intensity; 

6. Peak intensity position; 
Bottom chamfered surface: 

7. Surface length (top to bottom edge); 

8. Peak intensity; and 

9. Peak intensity position. 

Each of those characteristics are identified by number in FIG. 8B. Li addition to those 
characteristics, other characteristics may be identified including, for example, the surface 
width of each of the flat end surface 504 and both chamfered surfaces 506, by defining 
and analyzing fiirther vertical and/or horizontal analysis lines. In addition or in 
exception, the system 316 may search for the flat end surface 504 in the image of the 
chamfered surfaces 506 and/or the chamfered surfaces in the image of the flat end 
surface to confirm their absence fi*om those images. 

Once the various characteristics have been identified, a final determination is 
made as to the press-fit connection. Specifically, a final decision is made as to whether 
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the press-fit connection under inspection is acceptable or unacceptable (i.e., defective). 
Various decision making rules may be employed in making the final decision. With 
such rules, the measured characteristics of the pin tip can be compared with various 
reference values and/or with each other to determine, as to each characteristic, whether 
the characteristics indicate that the press-fit connection is or is not acceptable. By way 
of example, these rules may comprise: 

1 . Flat end surface length < V 1 ; 

2. Flat end surface width < V2; 

3 . Flat end surface peak intensity > V3 ; 

4. Top chamfered surface length < V4; 

5. Top chamfered surface width < V5; 

6. Top chamfered peak intensity > V6; 

7. Top chamfered surface peak intensity position < flat end surface 
peak intensity position; 

8. Bottom chamfered surface length < V7; 

9. Bottom chamfered surface width < V8; 

1 0. Bottom chamfered peak intensity > V9; and 

11. Bottom chamfered surface peak intensity position < flat end 
surface peak intensity position; 

where Vn is a reference value stored in memory. 

Through application of the decision making mles to the collected data, the image 
analysis system 316 determines which of the rales is/are satisfied and which of the rale 
is/are violated. The final decision is then made in view of those results. Notably, not all 
of the rales must be satisfied for the image analysis system 316 to determine that the 
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press-fit connection is acceptable. Moreover, violation of a single rule in spite of 
satisfaction of all others may indicate an unacceptable press-fit connection. Therefore, 
different weight can be applied to the rules so that more important characteristics (i.e., 
those most indicative of whether the press-fit connection is or is not acceptable) can be 
given more weight in the final decision than less important characteristics. For instance, 
if Rule 1 is not satisfied, it is unlikely that the press-fit connection is acceptable (z.e., not 
defective). Therefore, the system 316 may be configured to return an "unacceptable" 
press-fit connection if Rule 1 is violated. 

Once the final decision has been made, it can be presented to the system operator 
and, if any defects have been detected, appropriate measures can be taken to remedy the 
problem. 

FIGs. 9A-9B and FIGs. lOA-lOB provide examples of failing cases, ue., 
situations in which a defective press-fit connection is determined. Beginning with FIG. 
9A, shown is a composite image 900 in a viewing window 902 of a metal barrel 1 10 in 
which no pin has been inserted, for instance due to misalignment of the pin and the 
barrel during pin installation. In such a case, the image analysis system 316 will not be 
able to identify an actual pin tip to analyze. Instead, however, the system 316 may 
identify the barrel 1 1 0 as comprising a possible candidate for a pin tip. Accordingly, the 
system 316 may define an image analysis line 904 that crosses the barrel 110 (the 
identified ''pin tip"). FIG. 9B illustrates two plotted lines A and B representing the two 
channels of data along the analysis line 904 that comprise the composite image 900. As 
indicated in FIG. 9B, the two lines A and B are highly distinct fi-om the lines A and B of 
the properly-installed pin shown in FIG. 8B. Accordingly, analysis of the data that 
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comprises the lines A and B of FIG. 9B will result in a failure determination for the 
press-fit connection when the aforementioned rules are applied. 

FIG. lOA shows a composite image 1000 in a viewing window 1002 of an 
improperly installed pin 1004 within a barrel 110. In this case, the image analysis 
system 316 has established an image analysis line 1006 that crosses the tip of the 
improperly installed pin 1004. The plots that result from this analysis line 1006 are 
shown in FIG. lOB. As indicated in that figure, the plots A and B, representing the two 
channels of data, are again highly distinct from the lines A and B of FIG. 8B. 
Accordingly, analysis of the data that comprises the lines A and B of FIG. lOB will 
again result in a failure determination for the press-fit connection when the 
aforementioned rules are applied. 

In view of the foregoing, a method for inspecting a press-fit connection can be 
described as provided in the flow diagram of FIG. 11. As indicated in that figure, the 
method comprises capturing an image of a circuit board location at which a pin is to 
have been press-fit (block 1100), identifying a feature in a captured image that may 
comprise a tip of the pin (block 1102), measuring characteristics that pertain to 
particular features of the identified pin tip (block 1104), comparing the measured 
characteristics with at least one of stored reference values and each other (block 
1 106), and making a final decision as to whether the press-fit connection is acceptable 
based upon results of the comparing (block 1 108). 

A method for inspecting connection of an element to a circuit board can be 
described as provided in the flow diagram of FIG. 12. As indicated in that figure, the 
method comprises identifying a feature in a captured image that may comprise a 
known feature of the element (block 1200), measuring characteristics of the identified 
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feature (block 1202), comparing the measured characteristics with at least one of 
stored reference values and each other (block 1204), and making a final decision as to 
whether the connection is acceptable based upon results of the comparing (block 
1206). 
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